LOSS OF MEMORY OF RANDOM FUNCTIONS OF MARKOV 
CHAINS AND LYAPUNOV EXPONENTS 



PIERRE COLLET AND FLORENCIA LEONARDI 

Abstract. In this paper we prove that the asymptotic rate of exponential loss of 
memory of a random function of a Markov chain {Zt)tei, is bounded above by the 
difference of the first two Lyapunov exponents of a certain product of matrices. We 
also show that this bound is in fact realized, namely for almost all realization of the 
process (Zt)tgz, we can find symbols where the asymptotic exponential rate of loss 
of memory attains the difference of the first two Lyapunov exponents. This shows 
that the process has infinite memory and leads to a lower bound on the asymptotic 
exponential loss of memory which is saturated (and equal to the upper bound for an 
adequate choice of the symbols) on a set of full measure. 



1. Introduction 

Let (Xt) tgz be a Markov chain over a finite alphabet We consider a probabihstic 
function {Zt)tei, of this chain, a model introduced by Petrie (1969). More precisely, 
there is another alphabet ^ and for any Xt we choose at random a Zt in The 
random choice of Zt depends only on the value Xt of the original process at time t. 

We are interested in the asymptotic loss of memory of the process {Zt)t£z- For 
example, if the conditional probability of Zt given Xt does not depend on Xt, the 
process {Zt)t£z is an independent process. Another trivial example is when there is no 
random choice, namely Zt = Xt, in this case the process {Zt)t& is Markovian. However 
as we will see, under natural assumptions, the process {Zt)te'L has infinite memory. Our 
goal is to investigate how fast this process looses memory. 

Exponential upper bounds for this asymptotic loss of memory have been obtained 
in various papers, see for example Douc et al. (2009a,b), and references therein. For 
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the case of projections of Markov chains and the relation with Gibbs measures, see 
Chazottes & Ugalde (2009) and references therein. 

In the present paper, under generic assumptions, we prove that the asymptotic rate 
of exponential loss of memory is bounded above by the difference of the first two 
Lyapunov exponents of a certain product of matrices. We also show that this bound 
is in fact realized, namely for almost all realization of the process {Zt)t^z, we can find 
symbols where the asymptotic exponential rate of loss of memory attains the difference 
of the first two Lyapunov exponents. This shows that the process has infinite memory 
and leads to a lower bound on the asymptotic exponential loss of memory which is 
saturated (and equal to the upper bound for an adequate choice of the symbols) on a 
set of full measure. 

As an application, we consider the case of a randomly perturbed Markov chain with 
two symbols. We show that the asymptotic rate of loss of memory can be expanded 
in powers of the perturbation with a logarithmic singularity. This was our original 
motivation coming from our previous work with A. Galves (Collet et ai, 2008). 

The content of the paper is as follows. In Section 2 we give a precise definition of 
the asymptotic exponential rate of loss of memory and state the main results about 
the relation of this rate with the first two Lyapunov exponents. Proofs are given in 
Section 3. In Section 4 we give the appUcation to the random perturbation of a two 
states Markov chain. 



2. Definitions and main results 

Let {Xt)t£Z be an irreducible aperiodic Markov chain over a finite alphabet ^ with 
transition probability matrix p{-\-) and unique invariant measure vr. Without loss 
of generality we will assume ^ = {l,2,...,k}. Consider another finite alphabet 
^ — {1,2. ..,£}, with i > k, and a process {Zt)t^z, a probabilistic function of the 
Markov chain {Xt)tei. over ^. That is, there exists a matrix q{-\-) G M'^^^ such that 
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for any n > 0, any Zq G and any Xq G ^"^^ we have 

n n 

P(Zo" = z^\XS = x^) = UnZ, = z,\X, = X,) = l[q{zi\xi) . (2.1) 

1=0 1=0 

From now on, the symbol z will represent an element in Define the shift-operator 
Y: by 

(J^ z)n — Zn+1- 

The shift is invertible and its inverse is given by 

To state our results we will need the following hypothesis. 

(HI) minijj9(j|i) > 0, minj^„g(m|i) > 0. 
(H2) det(p) ^ 0, rank(g) = k. 

For the convenience of the reader we recall Oseledec's theorem in finite dimension, 
see for example Ledrappier (1984). As usual, we denote by log''"(x) = max(log(a;), 0). 

Oseledec's theorem. Let (Jl, //) he a probability space and let T be a measurable 
transformation of Q such that /i is T-ergodic. Let L^ be a measurable function from 
Q to ^(M^) (the space of linear operators ofM.'' into itself). Assume the function L,^ 
verifies 

log+ ||L;^||d/x(a;) < +oo. 



Then, there exist Ai > A2 > . . . > A^, with s < k and there exists an invariant set 
fl G fl of full measure {iJ,{fl\fl) — 0) such that for alluj & fl there exist s + 1 sub-vector 
spaces 

= yii) ^ Yi2) D . . . D = {0} 

such that for any v G vS^'' \ K;"'^^'* < j < s) we have 

lim -log||LW^;|| = A,-, 

n— »+oo n 
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where L^^^ = I/T"-i(a)) ■ ■ ■ L^- Moreover, the subspaces satisfy the relation 
The numbers Ai, A2, . . . As are called the Lyapunov exponents. 

In the sequel we will use this theorem with Q = fi the stationary ergodic measure 
of the process {Zt)tez (Cappe et ai, 2005), T = and the linear operator in 
with matrix given by 

{Lz)i,j = q{zo\j)p{j\i) . 

Prom now on we will use the norm || • || and the corresponding scalar product on 
R*^. Note that from our definition of we have 

sup II 1 1 < +00. 

z 

Therefore we can apply Oseledec's theorem to get the existence of the Lyapunov ex- 
ponents. 

For any z e Sf^, a e ^ and b,c e ^ define 

A^:l(z) = P(Xo = a I ZZI^, = zZl^„ ^-n = b) 

- P(Xo = a I Zzl+, = zZl+„ Z-n = c) 

and the asymptotic exponential rate Tz{a, b, c) given by 

T,{a, b, c) = hmsup - log | A[^"|,^^(^) | . 

n—*+oo ri 

We can state now our main results. 
Theorem 2.2. Under the hypothesis (HI), for each a e b,c& 

r^{a,b,c) < A2 - Ai, 

^-almost surely. 
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Remark. When £/ = ^ and q is the identity matrix, (Zt) = (Xt) is a Markov chain. 
The second part of hypothesis (HI) does not hold, but it is easy to adapt the proof of 
Theorem 2.2 for this particular case. It is easy to verify recursively that the matrices 
are of rank one. The Lyapunov exponents can be computed explicitly. One gets 
Ai = —H(p) (the entropy of the Markov chain with transition probability p) from the 
ergodic Theorem, and A2 = — oo with multiplicity k — 1. 

Theorem 2.3. Under hypothesis (H1-H2), for /i almost all z there exists a e 
b,c & ^ ( which may depend on z) such that 

rj^a, b, c) = A2 - Ai . 

As a corollary, we derive equivalent results for the loss of memory of the process 
{Zt)tez, which was our main goal. Define for any e,b,c E and any zEfl the value 

A^Xiz) = P(Zo = e I ZZI^, = zZl+„ ^-n = b) 

-FiZo = e\ZzUi = ^Zl^i,Z-n = c) 

and the exponential rate of loss of memory of the process {Zt)tez given by 

f^{e, b, c) = limsup - log | Aj."[^(^) | . 

n— »+oo ^ 

Corollary 2.4. Under the hypothesis (HI), for each e,b,c E ^, 

Tzie, b, c) < A2 - Ai, 

H-almost surely. Moreover, under hypothesis (H1-H2), for /x almost all z_ there exists 
e,b,c E (which may depend on z) such that 

fz{e, b, c) = A2 - Ai . 

Prom a practical point of view, one can prove various lower bounds for the quantity 
A2 — Ai. As an example we give the following result. 
Let 

1 
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Proposition 2.5. Under hypothesis (H1-H2) we have 

A2-A1 > ^^log|det(p)|--^logi?. 
3. Proofs 

We begin by proving some lemmas which will be useful later. We introduce the order 
(M^, <) given hy v < w \i and only if Vi < Wi for all i = 1, . . . , fc. When needed, we 
will also make use of the symbols <, > and >, defined in an analogous way. Note that 
since the matrices have strictly positive entries, ii v < w then L^v < LzW. We will 
use the notation 1 e M'^ for the vector with components (l)i = 1 for each i — 1, . . . ,k. 

Lemma 3.1. Under hypothesis (HI), if ^ ^ V^^ \ {0} then ^ has two non-zero com- 
ponents of opposite signs, ^-almost surely. 

~* (2) ~* ~* 

Proof. Assume there exits C G Vv \ {0} with > for all i = 1, . . . , /c. Then, from 
hypothesis (HI) it follows that there exists a > such that, for all z, 



One may take, for example. 



1 1 
We can apply L^y-i^ to both sides, use monotonicity and take norms, to obtain 

ll4"'eli > «iieliii^Krii- 

Let w e V^h^ \ V^l^. Then 

\\L^y-llw\\ < \\L^^--l\w\\\ < M\\L^^Zll\\<^\\L^M- 



Therefore 



and using Oseledec's theorem we have /i almost surely that 

lim -log||LMell > lim -log\\L^T.l[w\\ = Ai, 
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— * /o\ — # 

which contradicts the fact that ^ & Vz \ {0}. □ 

Lemma 3.2. Under hypothesis (HI) we have Codim(V2 ) = 1, ^-almost surely. 

Proof. Assume Codim(T4^^^) > 2. Since any vector wi of norm one in the cone — 
{w: w > 0} does not belong to vj^^ (by Lemma 3.1), the vector space Vz^^ ® Rwi is 
of codimension one, //-almost surely. Therefore we can find a vector W2 of norm one in 
'rfk\ivP ©Mwi). Note that 

inf llwi — — y|| > (3-3) 

since otherwise, the minimum is reached at a finite non zero pair (7, y) which would 
contradict W2 £ '^k\{Vz^^ ® Rwi). Let ^ be a fixed element in 
Define 

7„ = max — j-j and On = mm — ■ 

Let 



(f) — inf min 



z i,j,r,s {Lz)s,j iLz)r,i 

it follows from hypothesis (HI) that > and it turns out that this number is 
independent of z. Let 

1- ^ 1 
a — ^ < 1 . 

1 + 

From the Birkhoff-Hopf theorem, see for example Cavazos-Cadena (2003), there exists 
a constant /3 > such that for all z e and all n 

1 <^ < 1 + /3q;". (3.4) 

On 



We now prove that 



< Sn+l < 7n+l < In 



1 + pa' 

To see this observe that Sn+i < 7n+i by definition. We also have by monotonicity of 

(Li"^^Wl)j (L^-»2Li"'wi)j {Ly-nz-fnL^^^W2)i 

7^1+1 = max — p— j = max i-^^-j < max f— j = 7„ , 
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r \ r ~^ In 

7n 1 + /3 a" 

Since the sequence (7„) is decreasing, there exists 7* and > such that 

|7n-7*l < 

On the other hand, it follows immediately from (3.4) that for any i = 1, . . . , A;, we have 

-^^rrf!^ - (4"'-o.-T„(4"'».). < 0. 



Then there exists (3" > such that 

\\L'z Wi - •ynJ^z W2\ 



II r N ^ I 
\\L'z W2\ 

This imphes 



L\n] -t * r W 1 1 I * I 1 1 r f'il 1 1 1 1 r f^l ^ r W ^ I 

, ^z'Wi --f*L'k W2\\ ^ |7n - 7*|||LL 'W2II ^ WL^z'Wi - -fnLyW2\ 



\\Lrw2\\ \\LTw2\\ 1 1 -^i ""^211 

— * _ 

Since wi and W2 are linearly independent we have Wi — ^*W2 7^ 0. This and the previous 
inequality imply that 

lim -\og\\Lf\wi--f*W2)\\ < Ai+loga < Ai , 

(2) 

then wi — 7*W2 G W \ {0} and this contradicts (3.3). □ 
Proof of Theorem 2.2. First observe that 
F(Xo = a, ZZU, = zZl+^, Z-n = &) = 

n— 1 

n{x-n)q{b\x-n)p{a\x-i) Yl qiz^i\x-i)p{x-i\x-i-i) . (3.5) 



1=1 



Denoting by S^^l{z) the sum in (3.5) we have that 
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where 9b,ipa £ are given by 

{0,)i^n{i)q{b\i), 
{^a)i=p{a\i) . 

Observe that 

E4,te) =<«;,i';:iir> ■ 

By Lemma 3.1, as ('ifa)i > for any i — l,...,k, then ■0a ^ vl^\ //-almost surely. 
Prom Lemma 3.1 we have 1 e VP\VP. Therefore, by Lemma 3.2 we have that for 
any a e 

^fa = Ual + ia: (3.6) 

— * /n\ — * 

where Co £ ^ > '^a 7^ 0, 7^ by hypothesis (H2), and this decomposition is unique. 
Then 

S^:1{Z) = Ua< h , L^y-ll > + < , L^yZlL > 



and 



Therefore, 



Ua + 



Fix 60 G Define for any b, n and z 

<et,,L%-Ji> 



^ ft T ["-^1 f 



and 

^) = 76(n, ^) ^6 . (3.8) 

We have 

<^";„,L54r>= 5^(i).(L5:iJr), < RYli^,h{L^y-i^)^ 

i i 

— R <9h, > . 
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R"^ < lb{n,z) < R. (3.9) 

Then 
Note that 

I ^ ff, r ^ I > 



and 

f"-'^^"' < mn,z)-~e,{n,z)\\-\V^''~'^ 



< 0b{n,z) - e,{n,z) , L'^--,% > \ < mn,z) - e,{n,z)\\ ■ \\U^Z[%\ 

n-l] 



Then, using Oseledec's theorem we have 

T^{a,b,c) = hmsup ^ log \ A^^j^^^{z) \ < X2 - Xi- □ 
Before proceeding with the proof of Theorem 2.3 we will prove a useful lemma. 

Lemma 3.10. Under hypotheses (H1-H2), let Cl he a set of full /i measure where the 
Oseledec Theorem holds. Then for any z&Q., there exists a symbol a — a{z) & ^ such 
that ^ Vz \Vz , where 'is the vector in decomposition (3.6). 

Proof. By hypothesis (H2), the set of vectors {if a '■ a G forms a basis of R'^. Assume 
£ Vz^^ for all a. Then, as Codim(T4^^^) > 2, the set {^fa} generates a sub-space of 
co-dimension 1, which contradicts (H2). □ 

Proof of Theorem 2.3. Let Q be a set of full ji measure where the Oseledec's Theorem 
holds. Let z e Q, and let a — a{z) & such that ^ e V^^ \ The existence of 
such and element is guaranteed by Lemma 3.10. Let 
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We now show that there exists b and c such that 

hmsup I < 9h{n, z) — 9c{n, z) , ^a(^) ^) > | > , 

n— »oo 

where the vectors ^f,(n, z) and Oc{n, z) are defined by (3.8). Assume this is not the case, 
namely for any b and c 

hm I < Obin^z) - 9^71, z) , ia{n,z) > I = . (3.11) 

Choose for any n (and ^ fixed) a normahzed vector f{n,z) orthogonal to V;^i„^. Such 
a vector exists by Lemma 3.2. Note that for any b, n and z, we have from the bounds 
in (3.9) and the hypothesis (HI) 

< i?-^ min ll^cll < p6(^,^)|| < i?max||^c||- 

c c 

This implies that the vectors (/(n, ^), fa(n, ^), ^i(n, ^), . . . , Oi{n, z)) belongs to a com- 
pact subset of M'^^^+^). Therefore, we can find a subsequence {rij) of integers such 
that 

hm {f{nj,z),la{nj,z},h{nj,z),. . . ,et{nj,z)) = (/(^), CaU), ^lU), ■ ■ ■ , ^^U)) ■ 
The vectors /(^) and ^a(^) have norm one, and the vectors 9i,{z) satisfy 
< i?"^ min||^c|| < 11^6(^)11 < i?max||^c||- 

c c 

We have also for any b and c that 

< hU) - edz) , CaU) > = . 

We now show that the set of vectors {Ob{z)] contains a basis of M}. From hypothesis 
(H2), there exists {bi,. . . ,bk) G {1, . . . , i^^ such that 



det(el,...,4) ^0 
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Then 



Let 



and 



dct {9b,{z), eb,{z)) I = n I ■ ■ ■ ' I 

m=l 

> 7?-*= |det(4,...,^";j| >0. 

1 



m=l 



1 

C{z) = lim C(^^i,^) = r XI ^''-(^) • 



m=l 



We now observe that since all the components of the vector z) are strictly positive, 
and since by Lemma 3.1 any vector in V^-„^ has two components of opposite sign, we 
get 



mn,z),an,z))\ 

IIC(^,^)II 



inf 



C{n, z) 



\\C{n,z) 



-y 



> min 



,^( {C{n,z))i i 
\\\C(n,z)\\) 



> 1 mmb4{eb)i ^ Q 



||C(n,^)||J - kR' 



Taking the limit we get 



\{m,az))\ ^ 1 min,,,(g,), 
||CU)|| -/^i?^max,A 

We now define the orthogonal projection V on the orthogonal of / parallel to (, 
namely for any vector v 



Vv — V — ( 



Af,v) 



(/, C) 



We claim that the vectors {V{9bm{^) ~ ^bm+ii^))) jn=i k~i ^^^^ ^ basis of Indeed, 
if this is not true, there exists real numbers, cti, . . . , Oik-i, with at least one nonzero 
such that 



k-l 



J2'^rnr{ebjz)-0b^+M) = Q- 



m=l 
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In other words, there exists a number a such that 

fc-i 

m=l 

But this is impossible since the vectors {Ob^{z) — ^6^+i(:Z))^_^ and C form a basis 
oflR'^. Since 

(/U),CaU)) = lim {/{rij, z) , ^a{nj,z)) = 
we obtain that the normahzed vector ^a(^) would be orthogonal to the basis {'P{Obm{^)~ 
^bm+ii^))) jn=i k-1 which is a contradiction with (3.11). In other words, there 

exists a — a{z), b — b{z) and c = c{z) such that 

limsup I < 9i,{n, z) — 9c{n, z) , ^ai^, ^) > | > . 

Using the notations of the proof of Theorem 2.2 we have by the Schwarz's inequality 

||^[n-l] ^ II 

\ <9bo, ^y-iz^ > I 

1 1 ^'"-i' fall 

- [f,_°] ^ I < Ob(n,z) - ec{n,z) , ia{n,z) > \ . 

Il^f>()llll-^.r-izl|| 

Therefore, for this choice of a{z) e ^ and b{z), c{z) e ^ we have 

Tz{a, 6, c) = A2 - Ai . □ 

Proof of Corollary 2.4- The upper bound follows by noting that for all z e and 
e,b,c e ^ 

A5,eU) = (3.12) 

and then applying Theorem 2.2. We now prove that the upper bound is reached for 
almost all z e Lets suppose that for all ^ on a set of positive measure and for all 
e,b,c & ^ we have 

f^(e, b, c) < A2 - Ai . 

By (H2), as rank(g) = k there exists symbols ei,...,ek G ^ such that the matrix 
M e M.''^'' with elements Mjj = q{ei\j) is invertible. Denote by ul^}^ and vj"^^ the 
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vectors in with elements (ul^), = A^:l,^^iz) and (V^^Jj, = A^l{z). By (3.12) we 
have 

o,c,z o,c,z 

and as M is invertible 

= M-i 



c,z 



Then, for all a e =(2/ 

|AilU)| < lln^J < ||M-i||<Jj| < ^||M-imax{|A|rtU)|}. 

Applying the logarithm on both sides, dividing by n an taking limits we have that for 
all ^ on a set of positive measure, for all a e and for all b,c e ^ 

Tz{a, b, c) < A2 - Ai 

which contradicts Theorem 2.3. □ 

Proof of Proposition 2. 5. It is well known that the sequence of Lyapunov exponents 
Ai, . . . , As satisfy 

Ai + m2A2 + . . . + rUgXs = IE^[log | det L^\ ] , 

where the numbers denote the multiplicity of Aj, namely dim(V^^''^) = rrij + . . . + ms 
(see Ledrappier (1984)). In particular, l + m2 + . . . + ms — k. Let E = E^[log | detL^I ]. 
Then we have 

E < Ai + (A;-1)A2 

and 

A A > ^ ^ A 

Note that by Lemma 3.1, for almost all z we have 

Ai = lim ilog||4"'l|| < lim -log||l|| = 0. 

n— >oo n ~ n—KX> n 

Moreover, 

k 

detL^= ( JJg(^oK)) det(p) . 

i=l 
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Therefore, 

k 

A2-A1 > ^fog|det(p)| + ^^E^[fogg(-|z)] 

i=l 

1 k 
> -j^—^log\det{p)\ - i^—^logR. □ 

4. Perturbed processes over a binary alphabet 

Consider the chain {Xt)tez over the alphabet = {0, 1} with matrix of transition 
probabihties given by 

Po 1 - Po 
.Pi 1-Pi, 



P 



where we assume po ^ pi and 

< (3 = min{po, Pi 1 - Po, 1 - Pi} • 
The quantities p{j\i) are given by 

p(jK) = Pi,j ■ 

Consider also the process (^t)tgz over the alphabet ^ — {0,1} with output matrix 



Q 



1 — e e 
e 1 — e 



Lz,e 



such that Qij — P(^o — j I — i). Prom now on we will assume e e (0, l)\{l/2}. 
Then 

VzoPo {1 - r]z„){l - Po) 

rizoPl (1 -^^o)(l -Pl; 

where rjo — 1 — e and rji — e. We have the following equality 

Ai + A2 = E^[log|detL.,,|] 
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see for example Ledrappier (1984) for a proof. Therefore 

A1 + A2 = P(Zo = 0)log(r7o(l-r7o)bo(l-Pi)-Pi(l-Po)|) 
+ P(Zo = l)log(r^i(l -r^i)|po(l - Pi) -Pi(l -Po)|) 
= log e + log(l - e) + log I det(P) | . 

From the above expression for g we have 
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where 



M. 



{l-Zo)po Zo{l-po) 

[l-Zo)pi 2:0(1- Pi) 



and 



A,^ = {2zo - 1) 



Po -(1-Po) 
Pi -(1-pi) 



Note that 



sup||M;jq|| < 2 and sup||y4^o|| < 2. 



zo 



zo 



For 6 e {0, 1} define the vectors 



and 



^Po{l-b) + {l-po)b 
^Pi(l-6) + (l-pi)6^ 

pi{l - 6) - (1 - pi)b 



(4.1) 



Po{l - b) + {1 - po)b 
An easy computation shows that for any b we have 

P < \\eb\\ < V2 and P < \\fb\\ < \f2 . 

We recall that a distance d can be defined on Q as follows. For z_ and in Q, let 



^U,^') = inf{|i| , Zi ^ z[} . 
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Then 



We refer to Bowen (2008) for details, in particular Q equipped with this distance is a 
compact metric space. We now prove the following result. 

Lemma 4.2. There exists two constants cq > and D > and two continuous func- 
tions p{e, z) and h{e, z) such that for any e e [0, eo] the vectors 

g{e,z) = e^^ + eh{e,z)f^^ 

satisfy 

Lz,e g{e, z) = p{e, z) g{e, S^'^z) . 
Moreover, there is a constant U > 1 such that for any e e [0, eo]; (^ny n and any z e Q 



\\g{e,z)-e^^\\ < Ue, 



< Ue and U'' 1 < g{€,z) < Ul. 



Proof. The equation for g is equivalent to 



Lyz,€ ^(e, yz) = p(e, ^z) g{e, z) 



(4.3) 



Note that 



g{e, yz) = e;^ + e/i(e, yzjf^^ and Ly^^^ = + eA^^ . 

— * 

Taking the scalar product of both terms in equation (4.3) with e^j and /^j we get 

1 



p(e,yz) = 

and since Ml^f^^ = 

p(e, yz)h{e, z) 



-■zi I 



{M,^e,„ e,,) + eh{e, yz){M,J,„ e 



21/ 



(4.4) 



^) + e/i(e,^^)(A,J,2,/2i) 



LOSS OF MEMORY OF RANDOM FUNCTIONS OF MARKOV CHAINS 18 

We denote by V the Banach space of continuous functions on [0, eo] x Vt equipped with 
the sup norm. On the ball Bd of radius D = 16(3~^ centered at the origin in T> we 
define a transformation ^ given by 

where 

||e^ ||2 ^ iig^ ||2 ^ ^ 

11/21 II 11/21 II 

6^2) ^21) ~l~^(-^Zl^22) ^21 

) + e'^{A^J^^, e^i) and U4{e, z) = {M^Jz2, ^zi) ■ 

We first prove that ^ maps B£, into itself. Indeed for h G -B^), since D = 16(3~^ there 
exists Cq > small enough such that for any e G [0, eg] 

We leave to the reader the proof that ^{h) is a continuous function of e and z. We 
now prove that ^ is a contraction on Ed- For h and h! m. Ed, since = 16/3"^ there 
exists eo > small enough, and smaller than eg, such that for any e G [0, eo] we have 



\^m^.^)-^{h'){e,z)\ 



(u3{e, z) + eu4{e, z)h{e, 5^z)) {u-^ie^ z) + ew4(e, z)h'{e, S^z)) 



\h{e^z) — /i'(e, 



2 16 1 

By the contraction mapping principle (see for example Dieudonne (1969)), the map ^ 
has a unique fixed point h in Ed. It follows at once that the vectors 

g{€,z) = e^^ +€h{€,z)f^^ 

satisfy equation (4.3). The estimate on g{e,z) follows immediately from the fact that 
h G Ed, and the estimate on p{e,z) follows from (4.4). □ 

Remark. An easy improvement of the above proof allows to show that p and h depend 
analytically on e in a small (complex) neighborhood of 0. 



LOSS OF MEMORY OF RANDOM FUNCTIONS OF MARKOV CHAINS 19 

By the estimate on g{e,z) of the previous lemma and Lemma 3.1 apphed to the 
vector 1, we have fi almost surely 

lim -log||L'"Ii'j'(e,z)|| = lim - log 1|| = Ai . 

n— >oo n ^ z y n^oo n ^ z 



On the other hand from Lemma 4.2 it follows that 

n 

\og\\L^'^Zlg{e,z)\\ = Y.^ogp{e,y-^ z) + \\g{e,y-'^z)\\ . 

j=0 

Using again the estimate on g{e,z) from Lemma 4.2, the Birkhoff ergodic theorem 
(Krengel, 1985) and the ergodicity of /x, we have /x-almost surely 



Since 



Ai = y" log p{e,y-^z)di^{z) . 



mf > — , 

21,22 Czi Z 



it follows from Lemma 4.2 and a direct computation that 
A. = /log(<^^||||^)dM.) + OW 

= \0g(!^^^j^^^^r^^^^ 

62:1 ^ 



= 7r(0)i/(po)+7r(l)i/(pi) + C»(e), 

where for a number x e (0, 1), H{x) = a; log a; + (1 — x) log(l — x). The following 
theorem is an immediate consequence of the above estimates. 

Theorem 4.5. If po 7^ pi, minjpo, Pi ^ — PoA ~ Pi} > and e > is small enough 

we have p-almost surely 

r,ia,b,c) < loge + log|det(P)|-2[7r(0)//(po)+7r(l)i/(pi)]+C»(e). 

Moreover, for p-almost all z there is a triplet (a, b, c) (which may depend on z) where 
the equality holds. 



LOSS OF MEMORY OF RANDOM FUNCTIONS OF MARKOV CHAINS 20 

Proof. It is easy to verify that hypothesis (H1-H2) are satisfied. We therefore apply 
Theorems 2.2 and 2.3. The result follows from (4.1) and the above estimate on Ai. □ 
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